Lyric search service

ABSTRACT

This application relates to a client-server architecture that enables search queries to be applied to transcription information for multimedia files. A server device implements a service configured to query a search platform to retrieve results associated with a plurality of multimedia files stored in a content database. The results are ordered according to a plurality of heuristic values calculated based on a text relevance analysis. The service is configured to modify the heuristic values to adjust an order of the results, and generate a response to a search request that includes a representation of at least a portion of the transcription information of the multimedia files referenced by the results. The heuristic values are modified based on at least one of a popularity score for a corresponding multimedia file, a weight associated with a particular field, or a relevance score based on feedback signals.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.16/257,986, filed Jan. 25, 2019, entitled “LYRIC SEARCH SERVICE,” set toissue Aug. 31, 2021 as U.S. Pat. No. 11,106,722, which claims thebenefit of U.S. Provisional Application No. 62/668,192, entitled “LYRICSEARCH SERVICE,” filed May 7, 2018, the contents of all of which areincorporated by reference herein in their entirety for all purposes.

FIELD

The described embodiments relate generally to search services. Moreparticularly, the present embodiments relate to querying transcriptioninformation related to multimedia files stored in a content database.

BACKGROUND

Search algorithms have been developed that are uniquely tailored forquerying large datasets based on text-based data contained within a datarepository. Text-based search fails when the dataset is represented inanother format. For example, audio files are typically searched based onmetadata associated with the audio file (e.g., filename, artist, songtitle, etc.), but the search fails to compare a query string to audiowaveforms within the audio file.

In some cases, specialized services have been developed that can comparea query based on an audio snippet with a repository of audio files,searching for a match of the audio snippet to the audio waveforms withinthe audio files. However, these services cannot match a text-based querystring with the content contained within the audio waveform in the audiofiles. Consequently, a user cannot easily search for a song based on thelyrics of the song.

The best that a user can typically do is perform a text-based search onthe Internet and hope that the query matches a transcription of thelyrics in a song that is published on a website. Once the user has theinformation about the song, they can then perform another search tolocate an audio file of the song within a data repository maintained bya music sharing service.

SUMMARY

This paper describes various embodiments that relate to a client-serverarchitecture that enables search queries to be applied to transcriptioninformation for multimedia files. More specifically, a query string canbe compared with transcription information related to multimedia filesin a content database to return a list of results that specifiesmultimedia files that match the query string.

In some embodiments, a service receives transcription information for aplurality of multimedia files included in a content database. Theservice populates a document with data for a number of fields. Thefields include data sourced from metadata included in the multimediafile as well as data from the transcription information. The document istransmitted to an indexing service that parses the document and addsreferences to the media file to one or more indices maintained by adistributed search platform.

The distributed search platform maintains a separate index for each of aplurality of fields populated in the transcription document for themultimedia files. The distributed search platform receives a query for aparticular index and returns a list of references that match the query.A query service is configured to generate queries of one or more indicesmaintained by the distributed search platform, each query returning alist of references to multimedia files in the content database thatmatch the query string within a particular field of the transcriptiondocument.

In some embodiments, the distributed search platform calculates theheuristic values for at least some of the results by performing a textrelevance analysis on the transcription information for the resultsbased on one or more tokens in a query string. The text relevanceanalysis can comprise calculating a measurement of a token frequencyincluded in transcription information. The text relevance analysis cancomprise calculating a measurement of a term frequency—inverse documentfrequency (TF-IDF) for the transcription information. The text relevanceanalysis can comprise calculating a measurement of a token proximitywithin the transcription information.

In some embodiments, the heuristic values for at least some of theresults are modified based on a popularity score for correspondingmultimedia files. In other embodiments, the heuristic values for atleast some of the results are modified based on a weight associated witheach of a plurality of fields included in a corresponding transcriptiondocument. When the transcription information comprises song lyrics foraudio files, the heuristic values for at least some of the results aremodified based on weights corresponding to a particular field of thecorresponding transcription document associated each audio file.

In some embodiments, the response to the search request includes arepresentation of a snippet of the transcription information that isselected based on the query string. The snippet can be selected from thetranscription information by a snippet service configured to analyze thetranscription information based on the query string.

In some embodiments, the response to the search request is transmittedto a client device. A feedback signal can be received from the clientdevice. The feedback signal is utilized to compile a hint index that canbe queried to generate a search hint to display in a graphical userinterface of the client device. The search hint includes a snippet ofthe transcription information and an indication that the search hint isrelated to transcription information for the multimedia files.

In some embodiments, the multimedia files are audio files, and thecontent database is a music repository associated with a music sharingservice. The transcription information represents song lyrics for theaudio files stored in the music repository. In other embodiments, themultimedia files are video files, and the content database is a movierepository associated with a movie sharing service.

In some embodiments, the various functionality described herein can beimplemented by one or more services implemented by a plurality of serverdevices connected via a network. A client device can be configured tocommunicate with one or more of the services in order to query thetranscription information indexed within a distributed search databasethat maintains one or more indices related to transcription informationand metadata for the multimedia files.

This Summary is provided merely for purposes of summarizing some exampleembodiments so as to provide a basic understanding of some aspects ofthe subject matter described herein. Accordingly, it will be appreciatedthat the above-described features are merely examples and should not beconstrued to narrow the scope or spirit of the subject matter describedherein in any way. Other features, aspects, and advantages of thesubject matter described herein will become apparent from the followingDetailed Description, Figures, and Claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure will be readily understood by the following detaileddescription in conjunction with the accompanying drawings, wherein likereference numerals designate like structural elements.

FIG. 1 illustrates a client-server architecture, in accordance with someembodiments.

FIG. 2 is a conceptual view of a system for implementing a lyric searchservice, in accordance with some embodiments.

FIG. 3 illustrates a transcription document, in accordance with someembodiments.

FIG. 4 illustrates a client-server architecture for performing a searchbased on transcription information, in accordance with some embodiments.

FIGS. 5A-5B illustrate a search query performed utilizing theclient-server architecture of FIG. 4 , in accordance with someembodiments.

FIG. 6 illustrates a client-server architecture for generating searchresults including snippets of transcription information, in accordancewith some embodiments.

FIG. 7 illustrates search hints based on transcription information, inaccordance with some embodiments.

FIG. 8 illustrates a client-server architecture for generating searchhints, in accordance with some embodiments.

FIG. 9 is a flow chart of a method for querying transcriptioninformation related to multimedia content, in accordance with someembodiments.

FIG. 10 is a flow chart of a method for querying transcriptioninformation related to multimedia content, in accordance with someembodiments.

FIG. 11 illustrates a detailed view of an exemplary computing devicethat can be used to implement the various apparatus and/or methodsdescribed herein, in accordance with some embodiments.

DETAILED DESCRIPTION

Representative implementations of methods and apparatus according to thepresent application are described in this section. These examples arebeing provided solely to add context and aid in the understanding of thedescribed embodiments. It will thus be apparent to one skilled in theart that the described embodiments may be practiced without some or allof these specific details. In other instances, well known process stepshave not been described in detail in order to avoid unnecessarilyobscuring the described embodiments. Other applications are possible,such that the following examples should not be taken as limiting.

In the following detailed description, references are made to theaccompanying drawings, which form a part of the description and in whichare shown, by way of illustration, specific embodiments in accordancewith the described embodiments. Although these embodiments are describedin sufficient detail to enable one skilled in the art to practice thedescribed embodiments, it is understood that these examples are notlimiting; such that other embodiments may be used, and changes may bemade without departing from the spirit and scope of the describedembodiments.

In some embodiments, a service associated with a content databasereceives transcription information for multimedia files stored in thecontent database. The multimedia files can include any multimedia filethat includes an audio track, such as audio files or video files. Theaudio track can be transcribed, either manually or automatically, togenerate a text-based representation of the audio track. In the casewhere the audio track comprises a song that includes lyrics, thetext-based representation of the audio track comprises a document thatincludes a text string that recites the lyrics of the song. The lyricscan include words, separated by line breaks or other special charactersto denote logical breaks in the lyrics. Logical breaks can be identifiedbased on timing of measures of the instrumental portion of the audiotrack or, alternatively, based on the interpretation of the lyricsduring transcription such as by using instrumental or grammatical cluesto determine the logical breaks in the song. For example, a song can bewritten to include verses and a chorus, each of the verses and thechorus containing one or more lines of lyrics having logical breaksbetween the lines as well as between the verses and chorus.

In some embodiments, the service, responsive to receiving thetranscription information, populates a document with data for a numberof fields. The fields include data sourced from metadata included in themultimedia file as well as data from the transcription information. Thefields can also include a reference to a corresponding multimedia filewithin the content database. The document is transmitted to an indexingservice that parses the document and adds references to the media fileto one or more indices maintained by a distributed search platform.

In some embodiments, the transcription documents are indexed into adistributed search platform. More specifically, a separate index isgenerated for each field of the transcription document, the fieldsincluding at least one field for the transcription information and zeroor more fields relating to the metadata for the multimedia files. Forexample, a separate index can be maintained for a title field, an artistfield, and a transcription information field. A search query can begenerated for the distributed search platform that is applied to each ofthe indices maintained by the distributed search platform. The searchquery includes a query string that includes a number of tokens.

In some embodiments, the distributed search platform generates resultsfor the search query. The results for each of the queries of the one ormore indices are aggregated into search results and ranked based on aheuristic value calculated for each reference in the results. Theheuristic value can be calculated by the distributed search platformbased on a text relevance analysis of the query string relative to theindexed information in each of the indices of the distributed searchplatform.

The results are transmitted to a service for further processing. In someembodiments, the service re-ranks the results based on considerationsoutside the scope of a text-relevance analysis. For example, theheuristic values associated with each of the references returned in theresults can be adjusted based on a popularity score for thecorresponding multimedia file in the content database. As anotherexample, the heuristic values associated with each of the referencesreturned in the results can be adjusted based on the field of the indexthat returned the particular result.

In some embodiments, the search results can be displayed on a clientdevice. The representation of each result can include a relevant portionof the transcription information. A snippet service is utilized toanalyze transcription information related to a multimedia file togenerate a snippet of the transcription information related to aparticular query string.

These and other embodiments are discussed below with reference to FIGS.1-11 ; however, those skilled in the art will readily appreciate thatthe detailed description given herein with respect to these figures isfor explanatory purposes only and should not be construed as limiting.

FIG. 1 illustrates a client-server architecture 100, in accordance withsome embodiments. A server device 110 includes at least one processor112 and at least one memory 114. A client device 120 includes at leastone processor 122 and at least one memory 124. The client device 120 canalso include a display device 126. The client device 120 is configuredto communicate with the server device 110 via a network 150. The network150 can be a wired or wireless network including a cellular network orpacket-switched network such as the Internet.

As depicted in FIG. 1 , the memory 124 of the client device 120 storesinstructions executed by the processor 122. In some embodiments, thememory 124 of the client device 120 includes one or more applicationsconfigured to be executed by the processor 122 of the client device 120.The applications can include an operating system 102 that provides anoperating environment for one or more additional applications. At leastone application on the client device 120 can be a client application 104that is configured to interact with services implemented by one or moreserver devices accessible via the network 150. Examples of a clientapplication 104 can include, but are not limited to, an e-commerceapplication, a music sharing application, a fitness application, and thelike.

The client device 120 can include a display device 126, such as atouch-sensitive, liquid crystal display (LCD) or a touch-sensitive,organic light emitting diode (OLED) display. An application executing onthe client device 120, such as operating system 102 or clientapplication 104, can include a graphical user interface (GUI) presentedon the display device 126 that enables a user of the client device 120to provide input to the application and view visual output presented bythe application.

FIG. 2 is a conceptual view of a system 200 for implementing a lyricsearch service, in accordance with some embodiments. The system 200includes a plurality of software components executed on one or moreserver devices 110. Each server device 110 can include at least oneprocessor 112 and at least one memory 114 storing instructions for oneor more software components. As depicted in FIG. 2 , the softwarecomponents can include a content database 210, a service 220, a queue230, an indexing service 240, and a distributed search platform 250.

In some embodiments, the content database 210 is a distributed databaseconfigured to store multimedia content such as video files and/or audiofiles. The multimedia content can be encoded according to a well-knowncompression-decompression (CODEC) algorithm such as the Moving PictureExperts Group (MPEG) ver. 1/2 Audio Layer III (MP3) standard for audiofiles or the MPEG ver. 4 Part 10, Advanced Video Coding (MPEG-4 AVC orH.264) for video files. Other types of CODECS are contemplated forencoding multimedia content stored within the content database 210.

In some embodiments, each multimedia file added to the content database210 can include metadata related to the multimedia file. The metadatacan specify information for a number of fields such as a title, artist,year, genre, and the like. The metadata can be populated by a publisherof the multimedia file. This information can be populated by a producerof the multimedia file. In some embodiments, the metadata is included inan audio file as ID3 tags, which are data containers in an MP3 audiofile formatted according to a standard format defined in an ID3 version2 standard. Accessing the metadata is as simple as reading thecontainers included in the multimedia file. Alternatively, similarfields can be stored in the content database 210 along with themultimedia file such that the metadata is included in an entry of thecontent database 210. The metadata fields can be generated by theservice 220 when new content is added to the content database 210.

In some embodiments, the service 220 enables the client device 120 toaccess resources managed by the service 220. The service 220 canimplement an application programming interface (API) that can beutilized by the client application 104 on a client device 120 tointeract with the service 220. For example, a web-based service canimplement an API using a simple object access protocol (SOAP) or arepresentational state transfer protocol (REST) that enables the clientapplication 104 to access and/or operate on resources associated withthe service 220. The API can enable the client application to transmitdata to and/or receive data from the service 220. API calls can alsocause the service 220 to perform various operations and/or calladditional back-end services using additional API calls.

In some embodiments, the service 220 can create an identifier for eachmultimedia file added to the content database 210. The identifier canenable various services within the system 200 to reference themultimedia file stored in the content database 210. In some embodiments,the identifier is a universally unique identifier (UUID) based on theUniform Resource Name (URN) namespace defined in the Request ForComments (RFC) 4122 standard proposed by the Network Working Group ofthe Internet Engineering Task Force (IETF), which is herein incorporatedby reference in its entirety. The UUIDs generated based on the RFC 4122standard are 128-bit values that are unique to a particular multimediafile in the content database 210. In other embodiments, the identifieris simply an n-digit decimal integer such as, when n equals 6, a valuebetween 000000 and 999999, which provides for storing up to one millionunique multimedia files to be referenced in the content database 210.The value of n can be set based on the expected number of multimediafiles to be added to the content database 210.

Conventional techniques for searching the multimedia files in thecontent database 210 can include performing a search based on thecontents of the metadata for each file. For example, the multimediafiles can be indexed by tokens included in text strings stored in thetitle tag, artist tag, genre tag, and so forth in the metadata for themultimedia file. However, these metadata tags are insufficient to searcha multimedia file based on transcription information for the multimediafile. Transcription information can refer to lyrics of a song ormonologue or dialogue from a movie. As used herein, the term“transcription information” refers to generally a text-basedrepresentation of language included in an audio track of the multimediafile. In the case of audio files corresponding to a song, thetranscription information refers to a text-based representation of thesong lyrics.

In some embodiments, the service 220 is configured to receivetranscription information 205 corresponding to a multimedia file storedin the content database 210. The transcription information 205 can be afile that includes ASCII text that represents, e.g., the lyrics for asong or spoken portions (e.g., monologue and dialogue) of a movie. Thetranscription information 205 can be provided by a publisher of themultimedia content, transcribed manually by a third-party, ortranscribed automatically using speech recognition to translate theaudio waveform within an audio track into text in a particular language.

In some embodiments, the speech recognition can be performed utilizing amachine learning algorithm to process the audio waveform in an audiotrack to determine whether the audio file includes any spoken language,which are transcribed into a text file. In some embodiments, the audiotrack of the multimedia file can be parsed into smaller portions of theaudio track and provided as input to a classifier algorithm thatprovides a plaintext version of the token(s) included in the portion ofthe audio track.

The service 220 generates a transcription document 225 corresponding toa multimedia file in the content database 210. The transcriptiondocument 225 includes a number of fields storing data related to themultimedia file. The fields can include, but are not limited to: a fileidentifier field that includes a reference to a corresponding multimediafile; one or more fields storing data parsed from the metadata for themultimedia file; and one or more fields storing versions of thetranscription information associated with the multimedia file. A moredetailed description of the transcription document 225 is provided belowwith reference to FIG. 3 .

In some embodiments, the service 220 adds the transcription document 225to a queue 230 to be passed to an indexing service 240 associated with adistributed search platform 250. The queue 230 enables the service 220and the indexing service 240 to operate asynchronously. In someembodiments, the queue 230 is an Apache® Kafka distributed streamingplatform implemented on one or more server devices 110.

In some embodiments, the indexing service 240 monitors the queue 230 foravailable transcription documents 225. The indexing service 240 pops atranscription document from the queue 230, when available, and adds thetranscription document 225 to the distributed search platform 250. Insome embodiments, the distributed search platform 250 indexes the datain different fields of the transcription document into different indicesmaintained by the distributed search platform 250. Each index maintainedby the distributed search platform 250 can be queried independentlybased on a query string included in the search query.

In some embodiments, a query string includes a number of tokens. As usedherein, a token can refer to a word within the query string that caninclude multiple words separated by white space. More generally, a tokenrefers to one or more characters that, when combined, have a particularmeaning within a given language. For a particular field in thetranscription document 225, the indexing service 240 parses the data forthat field and adds an identifier of the transcription document 225 toan entry in a corresponding index maintained by the distributed searchplatform 250 for each unique token included in the data for the field.The transcription document 225 can also be stored in the distributedsearch platform 250.

In some embodiments, the distributed search platform 250 can comprisethe Apache® Solr enterprise search platform. The distributed searchplatform 250 can be implemented on a cluster that includes a pluralityof server nodes. A server node can refer to a server device 110.Alternatively, a server node can refer to a virtual machine (VM), whereone or more VMs are managed by a hypervisor executing on a server device110, the cluster comprising a plurality of server devices 110, eachserver device 110 executing one or more VMs.

The distributed search platform 250 can include logic for creating andmaintaining indices for different fields of the transcription documents225. An index refers to a database or other data structure that maps oftokens to transcription documents that include at least one instance ofthe token within a given field. Each indexed token can be associatedwith multiple transcription documents, and each transcription documentcan be indexed according to multiple tokens included in a particularfield. Each index can be queried to determine which transcriptiondocuments 225 contain particular tokens in the query string within agiven field of the transcription documents 225.

FIG. 3 illustrates a transcription document 225, in accordance with someembodiments. The transcription document 225 can include metadatainformation corresponding to a multimedia file as well as one or moreversions of the transcription information for the audio track of themultimedia file.

In some embodiments, the transcription document 225 includes a number offields. Each field includes a label as well as a value for the field. Asdepicted in FIG. 3 , the transcription document 225 includes a fileidentifier field 302 that stores a reference (e.g., an identifier) tothe corresponding multimedia file stored in the content database 210.The transcription document 225 also includes one or more fields formetadata included in the multimedia file. For example, the transcriptiondocument 225 of FIG. 3 includes a title field 304 that stores thecontents of a title ID3v2 tag parsed from the multimedia file.Additional fields for other metadata can be included in thetranscription document, such as fields for artist, year, or genre, amongothers.

In some embodiments, the transcription document 225 also includes one ormore fields for versions of the transcription information 205. A defaulttranscription information field 306 stores the text of the transcriptioninformation 205 as received by the service 220. It will be appreciatedthat the lyrics of a song have copyrights attached thereto and,therefore, licenses are required to publish the lyrics in certainjurisdictions. In some instances, a service provider of the service 220has licenses to publish the lyrics to a song worldwide and, therefore,the transcription document 225 can include one version of thetranscription information 205 in the default transcription informationfield 306 that can be displayed worldwide. In some cases, the serviceprovider does not have a license for a particular jurisdiction. Forexample, the service provider might have obtained a license to publishthe lyrics in some jurisdictions but not in the United States. As such,the transcription document 225 includes an override transcriptioninformation field for the United States (or any other jurisdiction),where the lyrics for the song are blank, indicating that the serviceprovider does not have a license to publish the lyrics in the UnitedStates.

In addition, in some jurisdictions, local laws may prevent certainlyrics from being published due to, e.g., obscenity laws or culturalnorms. As such, the transcription document 225 includes an overridetranscription information field for Japan (or any other jurisdiction),where the lyrics for the song are censored as displayed in thatjurisdiction. The service 220 generates the transcription document 225based on the transcription information 205 and policies related to legalrequirements in various jurisdictions.

In some embodiments, the distributed search platform 250 maintains anumber of separate and distinct indices for each of a plurality offields in the song document(s) 225. For example, a first index can storeinformation related to a title field of the transcription document 225,a second index can store information related to an artist field of thetranscription document 225, a third index can store information relatedto a default transcription information field (e.g., lyric data).Additional indices can be created for other fields in the transcriptiondocument.

Returning to FIG. 2 , in some embodiments, the indexing service 240receives a transcription document 225 and parses the value for each ofthe fields corresponding to the different indices of the distributedsearch platform 250. The indexing service 240 indexes the transcriptiondocument according to the tokens of each field. For example, if thetitle of a song is “Happy Birthday” then the indexing service 240indexes the transcription document in a first index according to a firsttoken (“happy”) and a second token (“birthday”), the entries for eachtoken in the index modified to include the reference to the documentidentifier for the transcription document 225. Consequently, any querystring that includes either the first token or the second token willreturn a document identifier for the transcription document 225 in thesearch results that indicates that transcription document matches thequery string.

It will be appreciated that lyrics for a song include a number ofdifferent lines of text, such that a given transcription document 225will be indexed according to a number of distinct tokens that may numberin the high tens or hundreds of tokens. Each token can be found one ormore times in the default transcription information field 306 includedin the transcription document 225. Some tokens may only be listed oncewhereas other tokens may be repeated many times within the transcriptioninformation. In some embodiments, the entries of the distributed searchplatform 250 for an index corresponding with the default transcriptioninformation field 306 include statistical information related to a tokenfrequency and a list of positions of the tokens within the transcriptioninformation.

In some embodiments, tokens are normalized to be case insensitive. Forexample, characters can be modified to be lower case. In someembodiment, tokens associated with common words can be discarded. Forexample, common words such as “the”, “of”, “a”, and the like are notutilized to index the transcription document 225 in the distributedsearch platform 250.

In some embodiments, the distributed search platform 250 is configuredto perform text relevance analysis on a document being indexed in orderto generate statistical data related to a particular token. Thestatistical data can include a number of times the token appears in thedocument (e.g., a token frequency), a measure of the percentage oftokens in the document that match the particular token, and/or a list ofpositions of the token within the document. This statistical data can becalculated when the document is indexed and stored in an entry of thedistributed search platform 250 along with the document identifier forthe transcription document 225.

FIG. 4 illustrates a client-server architecture 400 for performing asearch based on transcription information, in accordance with someembodiments. The client-server architecture 400 includes a clientapplication 104, a query service 420, and the distributed searchplatform 250. The client application 104 is included in the memory 124of the client device 120 and executed by at least one processor 122 ofthe client device 120. The query service 420 is included in a memory 114of a server device 110 and executed by at least one processor 112 of theserver device 110. The query service 420 is accessible by the clientapplication 104 by way of a network 150 such as the Internet.

The query service 420 provides a front-end to the distributed searchplatform 250. The operation of the client application 104, the queryservice 420, and the distributed search platform 250 is described inmore detail below with reference to FIGS. 5A-5B.

FIGS. 5A-5B illustrate a search query performed utilizing theclient-server architecture 400 of FIG. 4 , in accordance with someembodiments. As depicted in FIG. 5A, the client device 120 is a mobiledevice such as a cellular phone or a tablet computer. It will beappreciated that the client device 120 can include other types of clientdevices 120 such as a laptop computer, a desktop computer, a wearabledevice (e.g., a smart watch), a personal digital assistant, and thelike. The client device 120 can execute an application that presents aGUI on the display device 126 of the client device 120. The GUI caninclude a search query interface element 502 that enables a user of theclient device 120 to provide a query string 510 to the application. TheGUI can also include a virtual keyboard 504 that enables a user of theclient device 120 to type the query string 510 by touching portions ofthe display device 126 corresponding to virtual keys of the virtualkeyboard 504.

In some embodiments, the search query interface element 502 isimplemented in an operating system of the client device 120 and enablesa user of the client device 120 to search for files stored in the memory124 of the client device 120. In some embodiments, the query string 510entered via the search query interface element 502 can be transmitted tothe query service 420 via a network 150 in order to enhance the searchresults presented to a user to include resources that are not storedlocally on the client device 120 but are nevertheless accessible to theclient device 120 via the service 220.

In other embodiments, the search query interface element 502 isimplemented in a client application 104 of the client device 120 andenables a user of the client device 120 to search for files stored inthe memory 124 of the client device 120 or accessible over a network 150via the service 220. For example, a client application 104, such as ane-commerce application, can be designed to include the search queryinterface element 502 to search for content available for download tothe client device 120 via a service corresponding with the e-commerceapplication. As another example, a client application 104, such as amusic sharing application, can be designed to include the search queryinterface element 502 to enable a user to search for songs available viaa music sharing service.

In some embodiments, the client application 104 is a web-basedapplication displayed within a browser of a client device 120. Theclient application 104 can include a series of resources (e.g.,hypertext markup language (HTML) documents, images, scripts, etc.)requested from a web server associated with a website. The browserreceives the resources and interprets the resources to display arepresentation of the website on the display device 126. The clientapplication 104 is therefore platform-independent in that the clientapplication 104 can be displayed on a plurality of different clientdevices 120 running different operating systems.

As depicted in FIG. 5A, a user enters a query string 510 in the searchquery interface element 502. The query string 510 is a character stringincluding one or more tokens. The client application 104 processes thequery string 510 to generate a search request. In some embodiments, theclient application 104 optimizes the query string 510 such as bynormalizing the tokens included in the query string and/or discardingcommon words from the query string, as described above.

In some embodiments, the query string 510 is inserted into an HTTPmessage that is addressed to a Uniform Resource Locator (URL) for thequery service 420. In some embodiments, the query string 510 is includedin the URL for an HTTP Get message. Alternatively, the query string 510is included in the URL for an HTTP Post message. In some embodiments,the query string 510 is formatted as a JavaScript Object Notation (JSON)document that is included in the body of the HTTP message. It will beappreciated that other methods for transmitting the query string 510 tothe query service 420, such as formatting the query string 510 as anExtensible Markup Language (XML) document, are contemplated as beingwithin the scope of the present application.

In some embodiments, the query service 420 receives the query string 510and generates one or more search queries for the indices of thedistributed search platform 250. The distributed search platform 250implements an API for querying the indexed documents in each of the oneor more indices. The distributed search platform 250 processes eachquery and generates a result that is returned to the query service 420.In some embodiments, the result is a list of references to one of thetranscription documents 225 indexed by the distributed search platform250.

In some embodiments, the distributed search platform 250 is configuredto parse the query string 510 to separate each of the tokens included inthe query string. The distributed search platform 250 fetches a list oftranscription documents 225 associated with each token in the querystring 510, and generates a list of all documents that comprise anintersection (e.g., A n B) of the lists of documents for each individualtoken in the query string 510. The result of the intersection is thenprovided as a list of results to the query service 420. In someembodiments, the query service 420 and/or the client application 104 canspecify a maximum number of results to return in the list of results,such that the number of transcription documents 225 referenced in thelist of results is capped. For example, the list of results can becapped at 100 transcription documents 225.

In some embodiments, the distributed search platform 250 can beconfigured to rank the results based on a text relevance analysis. Aheuristic value can be calculated for each transcription document 225 inthe list of results based on the relevance of the query string 510 tothe corresponding field in the transcription document 225. The heuristicvalue can comprise a combination (e.g., sum, average, etc.) of a numberof measurements or scores.

In some embodiments, the heuristic value comprises a measurement of afrequency of each token in the query string within a field of a giventranscription document 225. Transcription documents 225 that include atoken multiple times result in a larger heuristic value compared totranscription documents 225 that include a token only once. Theheuristic value increases proportionally with increasing frequency. Thefrequency of each token in the query string 510 can be added together tofind a composite frequency measurement for the query string 510. In someembodiments, the frequency for a given token is calculated as the totalnumber of instances of the particular token in a given document dividedby the total number of tokens in the document. The composite frequencycan then be calculated by multiplying each frequency measurement for thetokens in the query string 510, and, optionally, normalizing thecomposite frequency based on the total number of tokens in the querystring 510.

In some embodiments, the heuristic value comprises a measurement of aterm frequency—inverse document frequency (TF-IDF) for a token. TheTF-IDF is a weight that is proportional to token frequency in a givenfield of the transcription document 225 and inversely proportional totoken frequency in the corpus of all transcription documents 225 indexedby the distributed search platform 250 for that field. For example, eventhough the token “love” may appear more frequently than other tokens ina particular transcription document 225, the token “love” may appearmore frequently, in general, across all transcription documents 225indexed by the distributed search platform 250 compared to other tokens,such that increased frequency related to the token “love” is lessexceptional than increased frequency of more rare tokens. In someembodiments, token frequency is calculated as the total number ofinstances of the particular token in a given document divided by thetotal number of tokens in the document; and inverse document frequencyis calculated as the natural logarithm of the total number of documentsdivided by the number of documents that include the token. The tokenfrequency is multiplied by the inverse document frequency to calculatethe TF-IDF.

In some embodiments, the heuristic value comprises a measurementcalculated utilizing the BM25F best matching ranking function, sometimesreferred to as Okapi BM25F.

In some embodiments, the heuristic value comprises a measurement oftoken proximity. Token proximity refers to how closely an order andproximity of tokens in the query string 510 matches an order andproximity of tokens in the field of the transcription document 225. Forexample, a query string of “happy birthday” will correspond to a highheuristic value for a transcription document 225 that includes thetokens “happy” and “birthday” adjacent within the field of thetranscription document 225 compared to a document that includes “happy”in one portion of the field and “birthday” in another portion of thefield separated by a large number of unrelated tokens.

The distributed search platform 250 calculates the heuristic value foreach document in the list of results and ranks each document in the listof results according to the heuristic values. The distributed searchplatform 250 provides the ranked list of results to the query service420. The query service 420 adjusts the ranking generated by thedistributed search platform 250 as part of the text relevance analysis,as described in more detail below.

In some embodiments, the query service 420 promotes certain results overothers based on popularity of the multimedia content. Popularity can bedetermined based on a number of times the multimedia content has beenaccessed or downloaded from the content database 210. Weights can becalculated for each transcription document 225 in the list of resultsbased on a popularity score for the corresponding multimedia file, andthen the heuristic value can be adjusted by multiplying the heuristicvalue by the popularity score or a normalized or quantized popularityscore. Adjusting the heuristic values based on popularity score promotesresults associated with popular content over other results associatedwith less popular content.

In some embodiments, the popularity score is only used to promoteresults over other results having the same heuristic value. In otherwords, popularity of the content is only utilized as a tie-breaker whenthe heuristic value cannot differentiate between two results. Forexample, if a query string for an artist matches multiple songs by agiven artist, then the heuristic value for each of the results can bethe same, and then the popularity score is utilized by the query service420 to promote results related to popular songs of that artist overother songs by that artist in the ranking.

In some embodiments, the query service 420 can generate multiple queriesbased on the query string 510 for each of the different indicesmaintained by the distributed search platform 250. For example, a firstquery is provided to the distributed search platform 250 that searchesfor any transcription documents 225 having a title that matches, atleast in part, the tokens in the query string 510; a second query isprovided to the distributed search platform 250 that searches for anytranscription documents 225 having an artist that matches, at least inpart, the tokens in the query string 510; and a third query is providedto the distributed search platform 250 that searches for anytranscription documents 225 having lyrics that match, at least in part,the tokens in the query string 510. The list of results for each queryare then aggregated by the query service 420.

In some embodiments, the query service 420 adjusts the heuristic valuesincluded in the results returned by the distributed search platformbased on the corresponding index that produced the results. Morespecifically, the query service 420 adjusts the heuristic values in theresults by multiplying the heuristic values by a weight corresponding toeach of the one or more fields of the transcription documents 225. Forexample, a query string that matches a title of a song or artist is morelikely to be a relevant search result than a query string that merelymatches a portion of the lyrics of a song. Therefore, the heuristicvalues for results based on the title index or the artist index areincreased and/or the heuristic values for results based on thetranscription information are reduced. By multiplying the heuristicvalue associated with each transcription document 225 in the list ofresults by a weight according to a field corresponding to the index of agiven query, the aggregate list of results is re-ranked when compiled topromote results related to titles or artists over lyrics, for example.The weights corresponding to each field can be set manually, or can bedynamically adjusted based on, e.g., a feedback signal that representswhich results are eventually selected by a user of the clientapplication 104.

Once the list of results has been re-ranked (e.g., re-sorted) duringaggregation by the query service 420, the query service 420 generates aresponse to the search request that is transmitted to the clientapplication 104 of the client device 120. In some embodiments, theresponse is provided in an HTTP message transmitted from the serverdevice 110 to the client device 120 via the network 150. The list ofresults can be formatted in a JSON document that can be parsed by theclient application 104 and formatted according to a desired displaypreference of the client application 104. Alternatively, the list ofresults can be formatted in an HTML document that is configured to bedisplayed in a browser of the client device 120.

As described above, the list of results comprises a ranked list ofdocument identifiers corresponding to transcription documents 225indexed by the distributed search platform 250, each transcriptiondocument corresponding to a particular multimedia file in the contentdatabase 210. However, the document identifier for the transcriptiondocument 225 is typically of little interest to the client application104. In fact, the document identifier for the transcription document 225may be kept private within the scope of the server-side of theclient-server architecture 400. In some embodiments, the query service420 generates a response to the search query by compiling informationrelated to a result from the transcription document 225. For example,the query service 420 can retrieve the transcription document 225referenced by the document identifier in the result from the distributedsearch platform 250, read the title and artist for the multimedia filefrom the transcription document 225, and format a search resultcorresponding to the transcription document 225 that includes a textstring that includes the title of the song and the artist of the song.

In addition, the search result can also include a snippet of the lyricsthat is related to the query string 510. The query service 420 can calla snippet service, discussed in more detail below, which returns aportion of the transcription information to the query service 420 thatmost closely matches the query string 510. This snippet of thetranscription information can be displayed along with the title andartist of the song.

The client application 104 displays the search results in a GUI of theclient application 104. Each result includes information included in thefields of the transcription document 225 associated with the particularresult. For example, as depicted in FIG. 5B, the search results caninclude, for a particular result such as result 520, information relatedto a song title, an artist, and a snippet 522 or sample of thetranscription information. The search results can also includehyperlinks or other user interface elements such as virtual buttons 524that enable a user to access or download the multimedia file from thecontent database 210.

In some embodiments, the query service 420 re-ranks results based onfeedback signals received from the client application 104. The clientapplication 104 displays the search results and users of the clientapplication 104 interact with the displayed results. A feedback signalis generated by the client application 104 and sent back to the queryservice 420 based on which results are clicked (e.g., selected) by auser within the search results. The query service 420 can aggregate thefeedback signals for a plurality of instances of a given query string,which provides a good indication of which results in the list of resultsare the most relevant for that query string. The query service 420 cancompile a dataset from a large number of client devices 120 and users,for each particular query string, to indicate the most relevant searchresults for a given query string. The query service 420 can then re-rankthe results in the list of results based on a relevance score calculatedaccording to the compiled feedback signals. Certain results can bepromoted if they are selected from the search results at high frequency.Other results can be demoted if they are selected from the searchresults at low frequency. For example, a default relevance score can beset equal to one, and the relevance score can be increased when a resultis selected or decreased when a result is not selected, as indicated bythe feedback signal. The relevance score can decay to zero over time ifthe result is infrequently returned in response to a given query string510. The relevance score can then be multiplied by the heuristic valueby the query service 420 prior to re-ranking the results in the list ofresults.

FIG. 6 illustrates a client-server architecture 600 for generatingsearch results including snippets of transcription information, inaccordance with some embodiments. The client-server architecture 600 issimilar to client-server architecture 400 except that a second, back-endservice, the snippet service 610, is utilized by the query service 420to generate snippets of transcription information for each resultreturned by the distributed search platform 250 in the list of results.The snippet service 610 is included in a memory 114 of a server device110 and executed by at least one processor 112 of the server device 110.The snippet service 610 is accessible by the query service 420 by way ofthe network 150.

In some embodiments, the query service 420 generates a request for asnippet that is transmitted to the snippet service 610. The request fora snippet can include a document identifier for a transcription document225 that is included in the list of results, the query string 510 for aparticular search query associated with the search result, and ajurisdiction identifier corresponding to the client application 104. Thesnippet service 610 retrieves a transcription document 225 from thedistributed search platform 250 that corresponds to the documentidentifier.

As previously mentioned, snippets of transcription information aregoverned by copyright law and, as such, displaying a representation ofthe transcription information on a display device 126 of a client device120 requires a license as long as the operation does not fall under thefair use doctrine. The transcription documents 225 are intentionallystructured to enable the snippet service 610 to automatically returndifferent representations of the transcription information based on theparticular jurisdiction associated with the client device 120.

In some embodiments, the snippet service 610 pulls the transcriptioninformation from the transcription document 225 according to thejurisdiction identifier included in the request. The jurisdictionidentifier for a particular client device 120 can be set when a userregisters the client device 120 with a service provider, such as byregistering a phone number or email address with the service providerand specifying a billing address associated with the client device 120.Alternatively, the client device 120 can determine a location of theclient device 120 using, e.g., wireless network information such as alocation of a nearby base station or an IP address of a wireless accesspoint. In some embodiments, the client device 120 includes a locationsensor, such as a GPS sensor, that can return the location of the clientdevice 120 based on a received wireless signal. The location can beutilized to determine which jurisdiction the client device 120 islocated within, such as a country, state, or other government entity.The client device 120 can be configured to map a current location, givenby, e.g., GPS coordinates, to a jurisdiction identifier such as a twoletter country code. The jurisdiction identifier can then be provided tothe query service 420, which provides the jurisdiction identifier to thesnippet service 610.

The snippet service 610 determines whether transcription information forthe jurisdiction specified by the jurisdiction identifier is includedwithin the transcription document 225. If transcription information forthe jurisdiction is included in the transcription document 225, then thesnippet service 610 retrieves the transcription information for thejurisdiction from the transcription document 225. Otherwise, the snippetservice 610 retrieves the default transcription information from thetranscription document 225.

The snippet service 610 then analyzes the transcription informationbased on the query string to determine the best match of the querystring to a portion of the transcription information. In someembodiments, the snippet service 610 identifies locations of tokens inthe transcription information that match tokens in the query string. Thesnippet service 610 then determines a portion of the transcriptioninformation that most closely matches the query string. Where thesnippet service 610 identifies multiple portions that match the querystring, then the snippet service 610 can find the best match based on,e.g., an order of the tokens and/or a distance between tokens in theportion of the transcription information.

In some cases, the snippet service 610 prioritizes portions of thetranscription information that are repeated multiple times over otherportions that are either not repeated or repeated less. For example, thesnippet service 610 can prioritize snippets included in the chorus of asong that is repeated multiple times over snippets included in a verseof a song, which may only be included in the lyrics for a song once,even if the snippet that is repeated is slightly less of a good matchbased on order or distance of tokens in the portion of the transcriptioninformation.

In some cases, the snippet service 610 does not find a match to thequery string within the transcription information. This can be the casewhere the document identifier for the transcription document 225 wasreturned in the list of results based on a match of the query string toone of the fields of metadata such as title or artist. In such cases,the snippet service 610 returns a portion of the transcriptioninformation that is most often repeated, such as a portion of the chorusof a song. Alternatively, the snippet service 610 returns a portion ofthe transcription information corresponding to a default snippet that ismanually specified in the transcription information as provided by thepublisher of the multimedia content or manually entered by a third partytranscriber or the service provider of the service 220. In yet othercases, the snippet service 610 is configured to provide, as a default, afirst portion of the transcription information.

As mentioned above, in cases where the service provider does not have alicense to display the transcription information to a user within agiven jurisdiction, the transcription information for that jurisdictioncan be empty. In such cases, the snippet service 610 can be configuredto return an empty snippet to the query service 420. Alternatively, thesnippet service 610 can be configured to return a default snippet to thequery service 420 that indicates the snippet cannot be displayed forreasons relating to copyrights (e.g., “The lyrics for this song arecovered by copyright and cannot be displayed in [jurisdiction].”).

In some embodiments, the query service 420 compiles snippets for theresults in the list of results and adds the snippets to therepresentation of the search results returned to the client application104 in the response to the search request. The snippets can be displayedproximate other information related to the result, such as underneaththe title and artist of a song, to provide context to why the result wasreturned in response to the query string. In some embodiments, thetokens in the snippet that match the tokens in the query string arehighlighted, such as by underlining the tokens, using a bold or italicfont to display the tokens, or changing the color of the font for thetokens relative to the font utilized for the remainder of the tokens inthe snippet.

FIG. 7 illustrates search hints based on transcription information, inaccordance with some embodiments. Various client applications 104 areconfigured to provide a user with search hints 720 when the user isentering a query string 710 in the search query interface element 502.For example, search hints for a query string that starts with “sw” canreturn a first search hint for a popular artist that starts with theletters “sw”, such as (Taylor) Swift, and a second search hint for apopular song title that starts with the letters “sw”, such as SweetCaroline. A new category of search hint, related to transcriptioninformation, can be provided to the client application 104.

As depicted in FIG. 7 , the search hint 720 for transcriptioninformation includes at least a portion of a snippet matching thecharacters in the query string 710 entered in the search query interfaceelement 502. The search hint 720 also includes an indication that thesearch hint is related to transcription information. For example, asdepicted in FIG. 7 , the search hint 720 can indicate the suggestedsearch hint is associated with song lyrics.

FIG. 8 illustrates a client-server architecture 800 for generatingsearch hints 720, in accordance with some embodiments. The client-serverarchitecture 800 is similar to client-server architecture 400 exceptthat a second, back-end service, the hint service 810, is utilized bythe query service 420 to generate search hints. The hint service 810 isincluded in a memory 114 of a server device 110 and executed by at leastone processor 112 of the server device 110. The hint service 810 isaccessible by the query service 420 by way of the network 150.

In some embodiments, the query service 420 utilizes the feedback signalto determine which results are relevant to a given query string 510. Therelevant result(s) and query string 510 are then transmitted to the hintservice 810, which indexes the relevant result(s), within the hint index820, according to the characters included in the query string 510. Theresult is indexed for each of a plurality of portions of the querystring 510 found at the beginning of the query string 510, each portionhaving a different number of characters up to the maximum number ofcharacters of the query string 510. Multiple results can be indexed,within the hint index 820 for each combination of characters based on aplurality of different feedback signals.

In some embodiments, the result can also be stored in an entry of thehint index 820 along with a frequency value that indicates the number oftimes the result was selected in response to a given query string 510.The frequency value is incremented each time the result is providedwithin a feedback signal to a corresponding query string 510. Thefrequency value can also be set to decay over a period of time such thatthe result will not be suggested as a search hint if the result has notbeen selected by at least one user recently.

For a given portion of the query string 710, the hint index 820 canreturn a list of results selected by users as indicated by feedbacksignals. The list of results can be sorted according to frequency valueto determine the most frequently selected result for a given querystring 510 that starts with the characters in query string 710. The topresult can be returned to the query service 420 as a search hint 720.More specifically, for a search hint 720 related to transcriptioninformation, the query service 420 can call the snippet service 610 toretrieve a snippet from a referenced transcription document 225 indexedin the hint index 820 based on the portion of the query string 710entered into the search query interface element 502. The snippet canthen be displayed in the search hint.

In other embodiments, the service provider can analyze the feedbacksignal(s) provided by the client application(s) 104 to populate the hintindex 820, manually. For example, a service provider can manually updatethe hint index 820 to return a particular result that is desired to beprovided as the search hint for a given combination of characters by theservice provider.

In some embodiments, the hint index 820 creates a different index foreach of a plurality of different fields of the transcription document225. The index for transcription information can simply store snippetsdisplayed within a selected result as provided in the feedback signalrather than a reference identifier for a song document. Consequently,the query service 420, or, alternatively, the hint service 810 does nothave to make a call to the snippet service 610 in order to generate asnippet related to the result to generate the search hint 720 fordisplay by the client application 104.

FIG. 9 is a flow chart of a method 900 for querying transcriptioninformation related to multimedia content, in accordance with someembodiments. The method 900 is carried out, at least in part, by one ormore server devices. The method 900 can be implemented by software,hardware, or a combination of software and hardware. In someembodiments, the method 900 is implemented by one or more of the clientapplication 104, the query service 420, and/or the distributed searchplatform 250.

At 902, a distributed search platform is queried to retrieve resultsassociated with a plurality of multimedia files stored in a contentdatabase. The results are ordered according to a plurality of heuristicvalues calculated based on a text relevance analysis. In someembodiments, the results comprise one or more lists of identifiers thatreference corresponding transcription documents that includetranscription information for the multimedia files. Each list ofidentifiers corresponds to a different index maintained by a distributedsearch platform for each of one or more fields of the transcriptiondocument.

At 904, the heuristic values are modified to adjust an order of theresults. The heuristic value for a given result can be modified based ona field in the transcription document associated with the index thatproduced the result or, alternatively, modified based on a popularityscore associated with the multimedia file specified by the result. Insome embodiments, the heuristic values can be modified based on arelevance score determined based on feedback signals received from oneor more client devices.

At 906, a response to a search request is generated that includes arepresentation of at least a portion of the transcription information ofthe multimedia files referenced by the results. The representation caninclude a snippet selected from the transcription information based on aquery string.

FIG. 10 is a flow chart of a method 1000 for querying transcriptioninformation related to multimedia content, in accordance with someembodiments. The method 1000 is carried out, at least in part, by one ormore server devices. The method 1000 can be implemented by software,hardware, or a combination of software and hardware. In someembodiments, the method 1000 is implemented by one or more of the clientapplication 104, the query service 420, and/or the distributed searchplatform 250.

At 1002, one or more indices related to the music repository are createdwithin a distributed search platform. At least one index maintained bythe digital search platform is related to lyric data transcribed fromthe plurality of audio files.

At 1004, the one or more indices are queried to generate search resultsbased on a query string. Each index can be queried separately togenerate a list of results related to a particular field of atranscription document.

At 1006, the results for each index in the one or more indices areaggregated to generate aggregated search results.

At 1008, an order of the aggregated search results is adjusted. In someembodiments, the heuristic value for each result in the aggregatedsearch results is modified by at least one of: a popularity scoreassociated with corresponding audio files in the music repository; aweight associated with a particular field included in a transcriptiondocument for the audio file; or a relevance score calculated based onfeedback signals.

At 1010, a representation of the aggregated search results istransmitted to a client device. The representation of the search resultsincludes at least one snippet of the lyric data for one or more audiofiles.

FIG. 11 illustrates a detailed view of an exemplary computing device1100 that can be used to implement the various apparatus and/or methodsdescribed herein, in accordance with some embodiments. In particular,the detailed view illustrates various components that can be included inthe computing devices illustrated in FIGS. 1 through 9 , and/ordescribed herein. For example, the client device 120, server device 110,or any other device including any network devices and/or consumerelectronics can include the components of computing device 1100.

As shown in FIG. 11 , the computing device 1100 can include a processor1102 that represents a microprocessor or controller for controlling theoverall operation of computing device 1100. The computing device 1100can also include a user input device 1108 that allows a user of thecomputing device 1100 to interact with the computing device 1100. Forexample, the user input device 1108 can take a variety of forms, such asa button, keypad, dial, touch screen, audio input interface,visual/image capture input interface, input in the form of sensor data,etc. Still further, the computing device 1100 can include a display 1110(screen display) that can be controlled by the processor 1102 to presentvisual information to the user. A data bus 1116 can facilitate datatransfer between at least a storage device 1140, the processor 1102, anda controller 1113. The controller 1113 can be used to interface with andcontrol different equipment through an equipment control bus 1114. Thecomputing device 1100 can also include a network/bus interface 1111 thatcouples to a data link 1112. In the case of a wireless connection, thenetwork/bus interface 1111 can include a wireless transceiver.

The computing device 1100 also include a storage device 1140, which cancomprise a single disk or a plurality of disks (e.g., hard drives), andincludes a storage management module that manages one or more partitionswithin the storage device 1140. In some embodiments, storage device 1140can include flash memory, semiconductor (solid state) memory or thelike. The computing device 1100 can also include a Random Access Memory(RAM) 1120 and a Read-Only Memory (ROM) 1122. The ROM 1122 can storeprograms, utilities or processes to be executed in a non-volatilemanner. The RAM 1120 can provide volatile data storage, and storesinstructions related to the operation of the computing device 1100.

The various aspects, embodiments, implementations or features of thedescribed embodiments can be used separately or in any combination.Various aspects of the described embodiments can be implemented bysoftware, hardware or a combination of hardware and software. Thedescribed embodiments can also be embodied as computer readable code ona non-transitory computer readable medium. The non-transitory computerreadable medium is any data storage device that can store data which canthereafter be read by a computer system. Examples of the non-transitorycomputer readable medium include read-only memory, random-access memory,CD-ROMs, HDDs, DVDs, magnetic tape, and optical data storage devices.The non-transitory computer readable medium can also be distributed overnetwork-coupled computer systems so that the computer readable code isstored and executed in a distributed fashion.

The foregoing description, for purposes of explanation, used specificnomenclature to provide a thorough understanding of the describedembodiments. However, it will be apparent to one skilled in the art thatthe specific details are not required in order to practice the describedembodiments. Thus, the foregoing descriptions of specific embodimentsare presented for purposes of illustration and description. They are notintended to be exhaustive or to limit the described embodiments to theprecise forms disclosed. It will be apparent to one of ordinary skill inthe art that many modifications and variations are possible in view ofthe above teachings.

What is claimed is:
 1. A method for querying transcription informationrelated to a plurality of multimedia files, the method comprising, by atleast one server device: querying a search platform to retrieve resultsassociated with the plurality of multimedia files, wherein the resultsare ordered according to a plurality of heuristic values calculatedbased on a text relevance analysis; producing an adjusted order of theresults by modifying the heuristic values for at least some of theresults based on weights associated with fields included intranscription documents that correspond to the plurality of multimediafiles; and generating a response to a search request according to theadjusted order that includes representations of one or more multimediafiles.
 2. The method of claim 1, wherein: each representation of amultimedia file includes at least a portion of transcription informationthat corresponds to the multimedia file, and the search platformcalculates the heuristic values for at least some of the results byperforming the text relevance analysis on the transcription informationincluded in the at least some of the results based on one or more tokensin a query string.
 3. The method of claim 2, wherein the text relevanceanalysis comprises calculating a measurement of a token frequencyincluded in transcription information.
 4. The method of claim 2, whereinthe text relevance analysis comprises calculating a measurement of aterm frequency — inverse document frequency (TF-IDF) for thetranscription information.
 5. The method of claim 2, wherein the textrelevance analysis comprises calculating a measurement of a tokenproximity within the transcription information.
 6. The method of claim2, wherein the transcription information comprises song lyrics for audiofiles, and wherein the heuristic values for at least some of the resultsare modified based on weights associated with a particular field of therespective transcription document that corresponds to each audio file.7. The method of claim 2, wherein the response to the search requestincludes a representation of a snippet of the transcription informationthat is selected based on the query string.
 8. The method of claim 1,wherein the heuristic values for at least some of the results aremodified based on a popularity score for corresponding multimedia files.9. The method of claim 1, further comprising: transmitting the responseto the search request to a client device.
 10. The method of claim 9,further comprising: receiving a feedback signal from the client device.11. The method of claim 10, wherein the feedback signal is utilized tocompile a hint index that can be queried to generate a search hint todisplay in a graphical user interface of the client device.
 12. Themethod of claim 11, wherein the search hint includes a snippet of thetranscription information and an indication that the search hint isrelated to transcription information for the plurality of multimediafiles.
 13. The method of claim 1, wherein, for a given field of thefields included in a transcription document that corresponds to a givenmultimedia file of the plurality of multimedia files, the associatedweight indicates a respective importance of the given field relative toother weights associated with other fields included in the transcriptiondocument.
 14. At least one non-transitory computer readable storagemedium configured to store instructions that, in response to beingexecuted by at least one processor included in a server device, causethe server device to query lyric data related to a plurality of audiofiles associated with a music repository, by carrying out steps thatinclude: creating, within a search platform, one or more indices relatedto the music repository, wherein the one or more indices include atleast one index related to lyric data transcribed from the plurality ofaudio files; querying the one or more indices to generate search resultsbased on a query string; adjusting an order of the search results toproduce an adjusted order; and transmitting a representation of thesearch results to a client device, wherein the representation of thesearch results is generated according to the adjusted order.
 15. The atleast one non-transitory computer readable storage medium of claim 14,wherein the order of the search results are adjusted based on at leastone of: a popularity score associated with corresponding audio files inthe music repository; a weight associated with a particular field of atranscription document that includes the lyric data for a particularresult; or a relevance score calculated based on one or more feedbacksignal associated with previous search queries of the music repository.16. The at least one non-transitory computer readable storage medium ofclaim 14, wherein the search results are aggregated based on a firstquery of the at least one index related to lyric data and one or moreadditional queries of additional indices related to fields of metadatain the plurality of audio files.
 17. The at least one non-transitorycomputer readable storage medium of claim 14, wherein: therepresentation includes at least one snippet of the lyric data for oneor more audio files, and each snippet is generated based on a textrelevance analysis of the lyric data for a corresponding audio filerelative to the query string.
 18. A server device for queryingtranscription information related to a plurality of multimedia filesstored in a content database, the server device comprising: at least oneprocessor; and at least one memory storing instructions that, whenexecuted by the at least one processor, cause the server device to:receive a search request that includes a query string from a clientdevice; generate a query for one or more indices of a search platformbased on the query string; receive a list of search results from thesearch platform, wherein the list of search results includes, for eachsearch result in the list of search results, a document identifier for atranscription document stored in the search platform and a correspondingheuristic value calculated based, at least in part, on a comparison ofthe query string with values from one or more fields of thetranscription document specified by the document identifier; modify anorder of the search results in the list of search results based on atleast one of a popularity score for the multimedia files or a weightassociated with each field in the one or more fields of thetranscription document; and transmit a response to the search request tothe client device, wherein the response includes a representation of atleast one multimedia file that is generated based on the modified orderof the search results.
 19. The server device of claim 18, wherein therepresentation includes at least a portion of the transcriptioninformation for the at least one multimedia file.
 20. The server deviceof claim 18, wherein the client device is configured to provide afeedback signal to the server device that indicates which result orresults in the list of search results were selected by a user of theclient device in response to displaying the representation within agraphical user interface of a client application.